DOCOHEIT BESOHB 



BD 154 665 

&OTHOB 
TITLE 

INSTITOTIOM 
POB DATE 
MOTE 

BDBS PRICE 
DESCBIFIORS 



J 



JC 780 272 ^ 

Alfred^ Richard L* ; Ivens^ Stephen H* 

A Conceptual Pranework for Institutional Research in 

Coiiunity Colleges* 

College Entrance Exanination Boards Men Torkr M<T« 
78 

HF-$0*83 Plus Postage* HC Sot Available froa EDRS* 
Adainistrator Role; Coaiunit; Colleges; Cost 
Effectiveness; Data Analysis; Data Collection: 
Decision Baking; Guidelines; ♦Institutional Research; 
♦Junior Colleges; ♦Bedels; Heeds issessaent; 
Objectives; Program Eveduation; Prograi Planning; 
Research Design; ♦Research Otilization 



ABSTRACT 

This paper defines a conceptual aodel for 
institutional research in the coi»unity college and identifies 
sources of inforaation^ prograas, and services that provide data 
necessary for iapleaentation of the aodel* The sodel contains four 
specific subsystefts: goal setting, progran developient, px^graa 
review r and cost effectiveness. Each subsystem distinctively relates 
to planning and decision making and each has coipcnent data fields 
that identify and organize information into subject categories. The 
data fields include coiiunityr students, prograis, and resources. In 
order for research in any subsystem to be valuable and an effective 
determinant in policy laking, it Bust take into account the various 
aspects of all data fields. Translation of" research data into 
planning concepts and alternatives is the crux of the research 
enterprise. After progran outcoie data have been collected, 
aanageaent guidelines are necessary to the translation process. 
Establishicig guidelines involves setting up systeiwide priorities and 
requires administrators to foriulate sone decision apparatus for 
converting data into action. A list of prograis^ services, and 
resource materials for the four subsystems is provided and includes 
such iteas as leasurenent instruments and reference works. (TR) 
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Introduction 

Emerging research trends in the two-year colleoes indicate that three 
major developments are now beginning to take place. These develop- 
ments have come about primarily in response to a need for assistance 
in institutional decision mak-r.g and have closely paralleled the in- 
creased emphasis on accountability fhat has'become the hallmark of the 
seventies. Perhaps the most significant development is a renewed em- 
phasis on applied rather than theoretical research, which has led to 
an increase in usable rather than abstract models. The steady 
increase in the number^cf^T'esearch projects devoted to specific prob- 
lems^ rather than general Investigation clearly reflects this shift In 
emphasi s , 

A second development is the redefinition of functional objectives 
in institutional research. The focus is now shifting to such matters 
as enrollment projections, outcomes In career programs, economic im- 
pacts of the col lege on the community, cost effectiveness, administra- 
tive organization, institutional goals, college governance, instruc- 
tional effectiveness, community needs, and many relatea topics. 
Studies that merely tabulate student characteristics no longer fulfill 
the information needs of potential users. Needed now are studies that 
concentrate on specific areas and individual needs, rather inen 
general student characteristics. In addition, surveys are required to 
determine the educational needs of particular segments of tha popula- 
tion such as rural and urban groups, ethnic minorities, r.lderly cit- 
izens, and women. 

Finally, Institutional research has become more sensitive to the 
ne^^ for empirical Information on whether community colleges meet the 
expectations of the communities they serve and the requ I reirents of 
legislative agencies, A premium is placed on information related to 
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the quality of impacts produced by_ the col lege as contrasted to those 
imposed on it by the - i nd i vt dua I s and groups using its services. This 
development is clearly reflected in the number of recent studies con- 
ducted to determine student outcomes in the educational process. 

Research Conceptualized 

Given this emphasis on tne practical asoects of research and the in- 
formation needs pf faculty and administrators, research can be defined 
as a process designed to assist institutions in: (1) defining their 
goals and purposes; (2) identifying programs and policies- that meet 
these goals; (3) evaluating programs to find out whether they are use- 
ful to the institution; and5y(4) mapping the flow of resources to de- 
termine the cost effectiveness of college programs. 

There are many sources of data, ranging from the expressed needs of 
community subgroupo to the published requirements of state agencies. 
The value of such resources fir a particular organization depends on 
the efforts of many to collect, organize, and apply the data when 
decisions are made. At thejr best, research data are a constructive 
tool for management to use in making key decisions and in implementing 
change; at their worst, they can be just window dressing for decisions 
that have already been made. Tv be constructive, research should have 
a direct effect on decisions concerning institutional goals and pur- 
poses and should affect the methods by which these decisions are made. 
For research to have such an effect on decision jnaking it must meet 
three essential conditions. First, it should help faculty and admin- 
istrators-establish instit Jtional goals and objectives; second, it 
should play an integral part in planning; and, third, it should pro- 
vide tne means for evaluating institutional programs and activities in 
rela-tion to stated goals. 
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There are several assumptions upon which these conditions are based: y 
K Facing an uncertain future, administrators are sehsitive to the 
need for research to assist in the formulation or modification of 
institutional goals where necessary, 

■Research, as an integral part of the decision-making process, both 
prece^Jes and follows the estabi ishment of institutional goals, 

■ Research, as a pivotal element in goal setting, plays a key role in 
planning for the long-range development of the institution, 

■ A ^ecognized apparatus exists in every institution for the conver- 
sion of research findings into planning concepts and decision 

al ternat i ves, 

■ Ccnprehensi ve data systems, once organized, will be used by faculty 
and administrators to assist in the development and guidance of in- 
divicual students, and to guide the further development of the insti- 
tution through variable internal and external conditions. 

If tnese conditions and assumptions are accepted, a conceptual 
fou'idation for research will be established and a system designed for 
ito organization into data fields. The purpose of this paper is to 
dfifine a conceptual model for institutional research in the community 
college and, where possible, to -identify sources of information, pro- 
grams, and services that can provide data needed to support the Im- 
plementation of the model. 

Institutional research in the community college can be described in 
a model that contains four specific subsystems: goal setting, program 
development, program review, and cost effectiveness. Each subsystem 
has a disiinctive relationship to planning and decision making, and 
each has component data fields that identify and organize information 
into subject categories. These data fields are: community, students, 
programs, and resources. Within I arger C0iT)mun i ty colleges, the last 
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data field may be expanded into facilities, finance, and staff, but 
since these three tend to operate together, the model is more simply 
served by the single data f ie I d— resources , Figure 1 is a diagram of 
the model just described^ showing the four subsystems and the four 
data fields with their relationship to institutional research and the 
p lann ing process. 

Before discussing in greater detail management's use of resej=3rch 
data for planning and decision making, it may be helpful to describe 
more fully each of the four subsystems of the model and the types of 
data that are incorporated into each of the four data fields. The 
descriptions that follow are meant to be illustrative and not 
exhaustive. 

Goal setting 

Most two-year colleges have a general set of goals based on a philos- 
ophy formulated at an early point in their development. Such goals, 
once developed, may receive little attention except in relation to 
visits from regional accrediting associations when an attempt may be 
made to relate them to descriptive data, collected after the fact, to 
demonstrate that the goals are indeed being met. Unfortunately, these 
goals normally are not defined in a way that makes them effective in 
guiding institutional development, nor do they receive regular review 
and evaluation by faculty and administrators to help make them a vital 
force in management. 

Every institution should collect data that can become a source of 
direction for determining the types of goals to be pursued. It is not 
enough for a college to commit itself to offering career programs 
simply because this is an objective usually set by a comprehensive 
community college. Ideally this goal should be determined in accord 
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gure I: Conceptual Model for Institui ional Research 



with data describing regional and local needr for career programs." It 
should be stated in terms of the total percentage of enrollment to be 
served by such programs, the relationships of these programs to man- 
power needs of the community, and the total number of positions 
available to program graduates. Similarly, a goal concerning guidance 
services should identify through' research the kinds of needs students 
have for. such services as well as the anticipated results. Obviously, 
the formulation of goals based on research data will not be easy in 
many areas, but the effort must be made if goals are to serve as a 
yardstick for institutional development. 

Within each of the four data fields, the following areas* of concern 
in the goal-setting subsystem serve as examples that need to be ad- 
(jressed by community college research. 

Goal Setting 
A. Community 

1. Geographical characteristics of the region served by the 
college region, including the size of the area, zoning 
characteristics, and natural barriers to campus development. 

2. Demographic characteristics of the region, including popula- 
tion density and characteristics, migration patterns, and 
transportation facilities. 

3. I ndustri a I /occupational characteristics, including manpower 
distributic and projected needs, number and types of busi- 
nesses ana' industr i es, rate of unemployment, and prospect of 

. "growth vs* ao growth" occupations, 
*4. Regional and state statutes regulating institutional goals. 
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B. Students • - 

K Individual and group perceptions of college goals. 
2,' National and regional enrollment patterns'", including intended 
fields of study and degree goals. 

C. Programs 

^. Opportunities for postsecondary education within the area, in- 
cluding number and types of postsecondary 'institutions, goals, 
primary clientele, and articulation policies and procedures, 

D. Resources . 

If Potential sources for outs'de or supplemental support for in- 
stitutional goal s. 

2. Staff inventory of special abilities and specific areas of ex- 
pertise. 

3. Facilities both on and off campus avai I ab le^ for institutional 
use. 

Program development 

The program development subsystem describes specific actions taken by 
the community colleges to achieve the' previous I y stated goals. The 
data fields of program development, although overlapping wi,th those 6f 
goal setting, tend to concentrate on the specific educational needs of 
the community. 

The development of programs based on objectives that reflect re- 
search on community needs carries forward the process through which 
^he institution's goals are crfeated. If the objectives are properly 
stated, they can enable faculty and administrators to appraise pro- 
grams according to their use o^^ current ' resources and measure their 
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effectiveness .against a series of immediate and long-range yardsticks. 
The types of institutional research needed in support of program de-- 
velopment can be summarized as follows. 

Program Development 

A. Community 

1. Educational needs and characteristics of secondary schooL^stu- 
^ dents and the adult population of the region served by the 
col lege. 

» 2. Local employers' perceptions and needs, and manpower projec- 
tions at the local, state, and federal levels. 

B. Programs 

1. Professional, state, and regional regulavions affecting pro- 
gram development. 

2. Specific program offerings in other postsecondary institutions 



1 .^-Enrohment projections. 
2. Educational needjs and characteristics of potential students 



in the region. 



Program strengths and weaknesses in feeder secondary schools. 



Students 




and enrolled students. 



Resources 



1. Projections cf program costs and revenues. 

it 

2. Projections of staffing requirements. 

3. Projections of amount and type of facilities required. 
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Program* review 

The third subsystem in the institutional research framework is program 

reviGw or, to giya it a more formal and potential ly threatening nam, 

program evaluation. This subsystem is perhaps the single most fou- 

tinely examined area in community college research today with the - 

focus of the research generally on student outcomes. 

Figure 2 shows the use of the concept of "outcomes" to describe 

the progress of students in relation to programs'. In this diagram, 

background characterisTics of entering students, objectives of the 

pr-ogram, and descriptive measures of the college environment are con- 

ft 

sidered "input," The "outcomes," observed throughout the program 
function, are measured and related to the "inputs" in oraer to obtain 
indices of program effectiveness. 

Programs can be measured at three different intervals: at the time 
of initial student enrollment (input); during the period of enrollment 
(functioning); and after termination of study (outcomes). Some of the 
studies typical I ' conducted in this area are the following, 

» 

in , Program Review 

A, Community > 

K Economic impacts of the college on the community, 

B, Students 

1, Characteri'^-tics of enrolled students, including xlemographic, 
intellective, and perceptual-atti tudinal , 

2, Attrition follow-up for both course and college withdrawal, 

3, Transfer fol low~up- , 

4, Graauate fol low-up, J ncl uding employment, satisfaction with 
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education and employment, and cert i f i cati on/ I i censure results, 
5. Perceptions of college. 

C, Programs 

K Course and program demand, including longitudinal analyses. 

D. Resources 

1. Faculty perceptions of college. 

2. Space utilization, including library facilities. 

Cost effectiveness 

The fourth subsystem in institutional research responds to the need of 
corrvnunity college planners for a gross" quant i tat i ve measure of the 
coslt effectiveness of present programs, for an analysis of the major 
consequences of present programs, and for an estimate of the major 
consequences of possible alternative programs. Since only enrollment- 
based information currently meets the criterion of credibility, cost 
effectiveness analyses have been limited to data relating only to 
numbers of students. At most, this type of analysis produces a unit 
cosf for each operation and should more appropriately be labeled "cost 
analysis." 

Some of the studies that have been conducted in this area provide 
the ingredients of unit cost: 

IV. Cost Effectiveness 

A. 'Community 

1. Federal, state, and community fur.ding levels across institu- 
tions and programs. 

r 
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B> Students 

h Enrollment analyses, including headcount, full-time enroll- 
ment, credit-hour production by coMege, division, department; 
course, and section. 

C> Programs 

K Costs of materials and supplies, 

D> Resources' 

1. Faculty and staff salaries and benefits, 

2, Energy and maintenance costs, 
3'. Facility costs/depreciation. 

Planning and Decision Making 

The translation of research data into planning concepts and alterna- 
tives to current plans is the crux of the research enterprise. Manage- 
ment decisions do not simply follow from the existence of' research 
data. There is a great need to increase management's awareness of the 
value of con-verting past, present, and future research data into 
planning concepts. When data on program outcomes have been collected, 
management guidelines are necessary for their translation into plan- 
ning ai ternativps. Establishing guidelines involves setting up 
systerriwide priorities and requires that administrators formulate some 
kind of decision apparatus for converting data into action. 

Many administrators fail to attend to this need for a decision 
apparatus and lapse into lethargy when they realize that they must 
assume a leadership role if planning is to be successful. The absence 
of a decision-making system allows the accumulation of a core of 
unanswered questions that plague educational planners: What are the 
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uses of research data in community colleges? What procedures should 
be used for the conversion of data into planning? Who should be re- 
sponsible for assessing the implications ot various data trends and ad 
vising management of alternative decisions to be made on the basis of' 
research data? What is an appropriate balance between politics and re 
search in the planning process? How can research data be used to im- 
prove management decisions? What is the value of planning in an insti 
tution if pofitical concerns often override planning alternatives? 
Questions such as these must be answered if two-year colleges are to 
conduct useful research programs. 

Figure 3 presents a decision diagram that depicts;,,the environment ^ 
for converting research findings into planning concepts. This schema, 
shows the potential for conflict in competing staff interests, a 
situation that has proven so dysfunctional for communil^^col leges. 
Ideally, planning shouj^d^be a graduated process that involves making 
decisions that strike an even balance between political consideration^^ 
and research data. Too often, political expediency has been the dom~ 
inant force in decision making, and research has been a superficial 
adjunct to the process. This tendency is most evident when adminis- 
trators manipulate research findings to fit a framework congruent 
with their own value expectations when they make decisions affecting 
the direction of the institution. 

Institutional constituencies, depending on their size and internal 
cohesi veness, bring different value perspectives to the decision- 
making process. To the extent that these value perspectives are 
identified and understood, research can be effective as a guide to in- 
stitutional development. By presenting faculty and administrators 
with different alternatives based on research findings, the research 
model can be used to forge decisions regarding long-range development. 
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'Figure 3: Decision Process Diagram 
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Using available data in combination with stated institutional goals 
and staff input, decision alternatives can be constructed. These al- 
ternatives can range from a solution that is purely political to a 
data-based approach to long-range planning. The lTK>st acceptable solu- 
tion, is likely to lie somewhere in the middle/ but by identifying 
potential alternatives faculty and administrators can begin to estab- 
lish criteria for future planning. 

In the absence of a decision-making system to convert research data 
into planning concepts, research already completed is often of limited 
value. A decision model should be developed that is sensitive to the 
political climate in which an institution functions as well as 
flexible enough to allow time for the-development of decision alter- 
natives. It should not be assumed that the values and interests of 
college constituencies will always be compatible with research data, 
but that admin istrators "wi I I ultimately be able to achieve- consensus 
on an objective base for planning if they are given accura+e and 

mean i nqfu I i nformat ion . 

The following annotated list of programs, services, and resource 
materials for the four subsystems is provided to assist readers in- 
terested in implementing components of the model described here. 

Annotated List of Programs, Services, and 
Resource Materials 

Goal Setting 

1. Institutional Goals Inventory (IGI>, Educational Testing Service 
An instrument to aid institutions ' in defining their goals, IGI 
should be specially useful in the planning and evaluation process. 
Results are reported for groups, not for individuals. 
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2. Occupational Outlook Handbook , 1976-77 edition, U.S. Department of 
Labor 

A standard reference for vocational guidance information covering 
job descriptions,^ required training, working conditions, and job 
gjrospects. See also. Occupational Handbook Quarterly and Occupa- 
tional Outlook .'or College Graduates , 1976-77 edition. 

3. Oregon Career Information System (CIS), 247 Hendricks Hall, Uni- 
versity of Oregon, Eugene, Oregon 97403 

' The CIS is a developing sy^s4;em for states that provides current 
labor market and educationaly information for individuals, schools, 
and social agencies. The purpose is to improve career choices and 
training opportunities. >.^^ 

4. State Postsecondary Education Profile Handbook , 1977 edition, Edu- 
cation Commission of the States 

A compendium of informcition, by state, that describes the educa- 
tional structure, presents descriptive statistics, and lists annual 
and biennial reports issued by state agencies, and special reports 
and studies currently under way or being planned. 

5. The Condition of Education , 1977 edition. National Center for 
Educational Statistics 

A statistical report that delineates the context and climate for 
education and describes educational activities, the institutions 
that offer them, and the persons who participate. The 1977 
edition repeats very little data from the 1975 and 1976 editions. 

II. Program Development 

1. Academic Unit Planning and Management (AUPM) , National, Center for 
Higher Education Management Systems 

AUPM is intended to help in ."-he identification and organization of 
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data about academic unit functions, the availability and alloca- 
tion of human and physical resources, the sources and uses of 
funds, and the planning and assessmen1| of outcomes. 
Admissions Testing Program Summary Re[;iorting Service , The College 
Board 

Summary reports describing the characteristics of approximately, 
one million high school seniors are produced each year by the 
College Board. Companion reports are also produced for schools^ 
postsecondary institutions, and states on students who partici- 
pate in the Admissions Testing Program, 

Adult and Career Education Survey (ACES), The College Board 
ACES is a questionnaire under development to assist industry and 
postsecondary institutions in assessing local community needs for 
educational programs and services. 

Higher Educ ation Enrollment Fprecasting , National Center for 
Higher Education Management Systems 

This 'document discusses the use of specific forecasting techniques 
and procedures that are applicable in a wide variety of situations. 
Illustrations of the most widely used techniques are provided. 
Student Financial Aid Management Services , College Scholarship 
Service of the College Board 

This is a flexible array of services designed to assist post- 
secondary institutions m many phases of the financial a'd 
process. Included are questionnaires to document student expenses 
and resources, and sof'ware programs to^manage financial aid 
awards. 

Student Outcomes Questionnaires , National Center for Higher Educa- 
tion Management Systems 

This is a series of questionnaires, with supporting materials, that 
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can be administered to entering, current, graduating, and nonre- 
turn ing studenj-s, as ^el I as recent and five-year alumni. The 
questionnaires were designed to support the collection of longitu- 
dinal data as well as collections for one-time use, 

?• Student Search Service Volume Projection Syctem, The College Board 
This system allows institutions to make projections of various 
market volumes using an interactive computer system and the files 
of the Student Search Service, 

8. Survey of Plans for Education and Careers (SPEC), The College 
Board 

SPEC is a questionnaire designed for local and statewide use to 
asst^ss the plans cff high school students for further education and 
for the world of work. This document is especially helpful for 
determining local educational needs of the graduating secondary 
school population. 

III. Program Review 

1 . A Manual for Conducting Student Attrition Studies in Institutions 
of Postsecondary Education , National Center for Higher Education 
Management Systems 

This manual provides educational planners with the tools necessary 
to, invest i gate and analyze decreasjng enrollments caused by stu- 
dents who permanently leave institutions, tnose who leave and plan 
to return, and those who transfer to other institutions. 

2. The College Board — Programs and Services 

^ a. Advanced Placement Program (APP). A program of instruction 
and examination in 13 academic areas to.assisr students in 
obtaining credit for college work done in secondary schools. 
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Career Skills Assessment Program (CSAP), A program of guid- 
ance, instruction, and assessment utilizing si^ separate self- 
ass^essment measures, designed for instructiona I ly relevant 
clusters of career skTMs, 

.Coll ege-Level Exarnination Program (CLEP)> A program of five 
general examinations and 47 subject examinations designed to 
assist students in demonstrating college-level proficiencies. 
Comparative Guidance and Placement Program (CGP), A compre- 
hensive collection of instruments designed to assist postsec- 
ondary institutions in curricular guidance and course place- 
ment for entering students. 

Descriptive Tests of Language Skills (DTLS), A developing 
program of diagnostic tests and curriculum guides in reoding 
comprehension, logical relationships, vocabulary, usage, and 
sentence structure, designed primari ly for use in postsecond- 
ary institutions. 

Descriptive Tests of Mathematics Skills (DTMS), A developing 
program of diagnostic tests and curriculum guides in compu- 
tation, elementary algebra, intermediate algebra, and elemen- 
tary^ functions. 

Student Descriptive Questionnaire (SDQ), A 63-item biograph- 
ical quest i onna i ne covering tbp'cs such as educational his- 
tory, extra-curricular activities, self-assessed abilities, 
and future educational plans. 

Test of Standard Written English (JSM) . A multiple-choice 
test intended to assist postsecondary institutions in English 
course placement, especially useful for studenfs who need 
additional instruction in written English usage. 



22 




I. Testing Academic Achievement (TAA). A program consisting of ^ 
recent AP Examinations andXLEP General Examinations an"d 
other College Board Achievement Tests, for institutional use 
in placement, exemption, credit and guidance decisions, 
j. ^ Transfer information Service (TIS). A service designed to 
support colleges and universities in their efforts to make 
their admissions, financial aid, and placemt^nt services res- 
ponsive to the needs of'transfer students, 
3. Educational Testing Service — Programs and Services 

a. College and University Environment Scales (CUES II), An in- 
strument deigned to enable an institution to find out how its 
students perceive its inte I lectua I -soci a I -cu I tura I climate, 

b. I nsti tutiona I Funct ion ing I nventory ( I Fl ) , An instrument that 
assesses perceptions of faculty, administrators, and students 
about administrative plans, teaching practices, and types of 
programs. 

c. Student Reactions to College (SRC), A questionnaire designed 
specifically to enable two-year and open-door college students 
to express views about their ccllege experiences, 

d. Student Instructional Report (SIR), An instrument designed to 
give faculty members an opportunity to have students evaluate 

< courses and instruction in a systematic and anonymous way, 

IV, Cost Effectiveness 

1, A Fact Book on Higher Education, Issues 1-4, American Council on 
Education, 1977 

This series of publications compiles data from documented sources 
and presents tht^.-n in a consistent and longitudinal format. The 
.four issues each year cover demographic and economic data. 
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enrollment data, and information about institutions, faculty, 
staff, and students, and earned degrees conferred. 
Faculty Activity Analysis , National Center for Hi gher^ Education 
Management Systems (three manuals and supporting software) 
These manuals provide techniques for collecting data that will 
serve as a foundation for allocating faculty salaries to institu- 
tional programs, and procedures for analyzing faculty activities, 
Halstead, D, Kent, Higher Education Prices and Price Indexes , U.S. 
DepaVtment of Health, Education, and Welfare, 1975 
This book provides current measures of inflation in higher educa- 
tion and will be particularly valuable to financial planners in 
postsecondary insti tutions. 
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